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Abstract 

This  paper  presents  a method  for  the  real- 
ization of  non-linear  estimators  based  on  spline 
interpolation.  The  difference  of  a monomial  and 
its  interpolating  spline  forms  a tnonospline  and 
then  a quadrature  formula  is  induced.  When  the 
knots  of  the  monospline  at  which  the  conditional 
density  is  discretized  are  allowed  to  vary,  a 
class  of  optLmal  quadrature  formulas  is  obtained. 
To  find  the  monospline  with  optimal  knots  a set 
of  non-linear  algebraic  equations  must  be  solved. 
If  the  symmetry  property  of  the  monospline  is 
applied,  the  order  of  the  non-linear  equations 
can  be  reduced  by  about  one-half.  An  iteration 
scheme  of  Newton  type  is  introduced  to  solve 
the  monospline.  The  quadrature  formula  asso- 
ciated with  this  monospline  has  the  so-called 
positivity  property  which  is  essential  in  the 
practical  implementation  of  non-linear  recur- 
sive estimators. 


1.  Introduction 

The  implementation  problem  for  non-linear 
estimators  of  the  state  in  a discrete  time  dyna- 
mical system  employs  a recursive  algorithm 
arising  from  Bayes  Law.  Many  numerical  ap- 
proaches for  this  implementation  problem  have 
been  developed  during  the  past  few  years.  These 
include  curve  fitting  the  conditional  density 
[1][2]  and  the  quadrature  approximation  to  the 
necessary  integrations  [3J[4](5].  The  essential 
step  in  ootainlng  the  conditional  density  of  the 
state,  given  the  observations,  is  integration. 

In  this  paper,  a method  using  quadrature 
formulas  related  to  monosplines  with  optimal 
knots  is  discussed. 

Consider  a discrete  time  dynamical  system 
given  by 


with  measurement 

X*  “ \ v e Rm  (2) 

The  noise  sequences  are  assumed  to  be  independent 
Guassian  random  vectors  with  zero  mean.  If  the 
p.d.f.  of  the  initial  state  is  assumed  to  be 
known,  the  conditional  density  function  of  the 
state,  given  the  observations,  can  be  computed 
by  the  following  recursive  equations  [6] 

lY  1 - u(Zk’VP(*JYk-l>  ... 

■*  k Ju(2k'5kip(^lYk-l)d^ 

and  r 

p(2k+1IV  " JT(2k+l,^)(^,Yk)d^  (4) 


where  $ is  filtering  density,  u is  measurement 
density,  t is  transition  density  and  p is  pre- 
diction density.  This  paper  attempts  to  approxi- 
mate the  necessary  integrations  in  (3)  and  (4) 
by  using  the  quadrature  formula  derived  from 
monospline . 

2.  Spline  Interpolation,  Monosplines 
and  Corresponding  Ouadrature  Formulas 

Let  s(x)  be  a snline  function  of  degree 
2m-l  with  distinct  knots  Xj,  x^,  . . .,  x in 
[-1,1]  and  k-fold  knots  at  -1  and  1,  where 
0<k<m<n+2k.  Then  if  a monomial  of  degree  2m, 
x7m/(2m).',  is  interpolated  by  s(x)  in  [-1,1], 
the  difference  between  these  two  functions  be- 
comes a monospline 
2m 

H<*>  - T^vT  - S(x) 


2m  2m  i-1 

* r „ _5 

(2m>:  ‘^,1  (1-d: 


V1  - +\  V 2k  e R"  (1)  ? . (x-x,)2m-1 

1 J T 

j-1  J (2m-l)! 

Tile  results  presented  in  this  paper  were  ob- 
tained with  the  partial  support  of  the  Air  Force  , 

Office  of  Scientific  Research  under  The  9PUne  Interpolation  asserts  that 

Grant  AF0SR75-2828.  Approved  for  p '1  ■ relo.-iso- 

distribution  unlimited. 
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HfXj)  - 0 

J-1. 

2 

n 

H(1\+l)  - 0 

i-X, 

1 

k-1 

(6) 

H<m+P)(±l)  = 0 

p=0. 

1,  •••, 

m-k-1 

K(x)  - ll(D,)(x) 

m 

X 

m! 

S(m)(x) 

(7) 

Then  the  or thogonal ity  property  of  spline  inter- 
polation implies  that  [7] 

| [K(x)J^  = minimum  (8) 

Since  K(x)eCm  for  any  function  f (xJeC^f-l , 1 ] , 
we  can  employ  integration  by  parts  to  get 

fl  n 

f(x)dx  « l A f (x  ) 

J-1  j=l  3 3 


+ Z [B  £(1)(-1)  + D ,f(1)(+l)l 
i-0 

+ (-l)m|1iK(x)£(m)(x)dX  (9) 

where  {A^},  {B^}  and  {D^}  are  the  coefficients 

of  the  derived  quadrature  formula  which  relate 
to  K(x)  by 

Aj  = £(m-1) (Xj_)  - K<m'n(xj4.)  - B. 


Tf  the  knots  are  allowed  to  vary,  a set  of 
optimal  knots  can  be  obtained  which  cause  the 
*s  to  vanish.  This  induces  so-called  optimal 
property  to  the  Quadrature  Formulas  (9),  [8]. 

3.  Numerical  Solution  for  the  Monospline 
with  Optimal  Knots 

Substituting  the  conditions  (6)  and  (14) 
into  (3),  2nrt-2n  non-linear  algebraic  equations 
are  obtained  in  the  2m+2n  unknowns,  {a^},  fBj) 
and  {xj}.  It  can  be  shown  (8]  that  a symmetry 
property  of  the  monospline  can  be  employed  to 
reduce  the  number  of  equations  and  unknowns  to 
m+n  when  n is  even  or  m-fn-bl  when  n is  odd.  This 
eliminates  even  terms  of  {ai). 

T 

Let  x * [x.  x0  ...  x 1 (16) 

\ l q 

and  y = f0l  a3  ...  “2m-l ,Sl*62’ ‘ ’ ’eq]T(17) 


where  q=n/2  when  n ts  even  or  q=n+l/2  when  n is 
odd.  Then  the  conditions  (6)  and  (14)  induce  the 
following  equations 

A(x)v  = z(x)  A:  (m+q)x(m+q)  (18) 

and  B (x)y  = w(x)  B:  9x(m+<i)  (!9) 


Let  n represent  all  the  unknowns 


and  combine  (18)  and  (19).  We  get 


(20) 


J-1,  2,  ....  n (10) 


f(n) 


[A(x)v  - z/xjj 
lB(x)y  - w(x.)| 


0 


(21) 


Bt  - (-l)i+1K(m_1"1)(-l)  i-0,  1 k-1  (11) 

D3  = (-l)1K(m'i'1)(+l)  i-0,  1 k-1  (12) 

K(x)  is  then  a kernel  of  the  derived  quadrature 
formula  which  has  remainder 

Rf  - (-1)”  f K(x)f(m)(x)dx  (13) 

>-\ 


For  the  case  2fm,  Oykym<2n+2k  and  {x,}  are 
double  knots,  a set  of  additional  condition  is 
induced , 


H,(V 


J-1,  2 n 


(14) 


and  (9)  has  additional  term  E £.f'(x,)  added  to 

J-1  3 3 

its  right  hand  side.  is  given  by 


„ K(m-2)(x  }_K(m-2)(x  ) 


J+' 


J- 

J-l,  2,  ....  n 


(15) 


The  Jacobian  of  (21)  is  computed  bv  taking  par- 
tial derivatives  of  f(_b)  with  respect  to  r\_. 

Since  (21)  has  a unique  solution,  the  inverse  of 
this  Jacobian  exists.  Partitioning  the  inverse 
Jacobian,  we  get 


,-l 


'A1 


B1  FT 


(22) 


where  A3:  (m+q)x(m+q),  B3:  qx(m+q),  E3:  (m+q)xq 
and  Fl : qxq. 


Since  (18)  is  linear  in  y if  x is  given, 
(21)  can  be  simplified  by  computing  v from  x. 
Then  we  get 


where 

£(x)  - B(x)A  ' (x)y(x)-w(x)  (24) 

Then  a modified  Newton’s  Iteration  equation 
(9)  can  be  used  to  obtain  x. 
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Sfc+1  “ VtkK^(^)  (25> 

where  Is  a scalar  factor  chosen  to  insure  the 
convergence  of  the  iteration  process,  e.fi. 

Il£.(ilk+1)|l  < I liifXfc)  I I (26) 

where  k is  the  Iteration  parameter. 

4.  Optimal  Quadrature  Formulas 
for  Updating  Procedure 

In  order  to  maintain  the  positivity  of  the 
discretized  density  function  in  the  recursive 
equations  only  those  quadrature  formulas  with 
k-*0  or  k“l  and  all  positive  weights  are  useful 
for  the  evolution  of  conditional  densities.  The 
optimal  quadrature  formulas  derived  from  the 
monospline  numerically  computed  In  the  previous 
section  have  all  positive  weights  and  require 
no  derivatives  of  the  integrand.  Hence,  O.O.F.'s 
are  practically  useful  in  non-linear  estimation 
problems . 


2.  Alspach,  I).  L. , and  H.  W.  Sorenson,  "Approx- 
imation of  density  function  by  a sum  of 
Gaussian  for  non-linear  Bayesian  estimation," 
Proceedings , Symposium  on  Non-linear  Estima- 
tion Theory,  San  Diego,  1970. 

3.  Hecht,  C. , "Digital  realization  of  non-linear 
filters,"  Proceedings,  2nd  Symposium  on  Non- 
linear Estimation  Theory,  San  Diego,  1971. 

4.  Kasemratanasunti,  W.,  and  R.  L.  Klein, 
"Implementation  of  non-linear  estimators 
using  quadrature  formulae,"  Int.  Journal  of 
Control,  Vol.  20,  1974. 

5.  Wang,  A.,  and  R.  L.  Klein,  "Optimal  Discre- 
tization and  updating  for  Oaross  quadrative 
estimators,"  Proceedings,  1^75,  IEEE  Control 
and  Decision  Conference,  1975. 

6.  Sage,  A.,  Optimal  System  Control,  Prentice 
Hall,  1968. 

7.  Prenter,  P.  Mt,  Splines  and  Variation  Method, 
John  Wiley  and  Sons,  1975. 


Numerical  experiments  indicate  that  the 
accuracy  of  the  approximation  by  O.Q.F.  can  he 
improved  by  increasing  m as  predicted  by  theory. 
However,  the  O.Q.F.  of  high  m is  more  sensitive 
to  the  truncation  factor  than  those  of  low  m. 

An  O.Q.F.  of  low  m may  give  better  results  if 
the  evolving  density  is  multimodal. 

In  the  realization  of  the  evolution  of 
conditional  densities,  the  concepts  of  floating 
grid  and  coordinate  rotation  are  employed  to 
efficiently  represent  the  density  functions  [5]. 
The  updating  algorithm  is  designed  so  that  the 
computational  efficiencies  of  parallelism  can  be 
exploited  for  real  time  applications. 


8.  Schoenberg,  I.  J.*  "Monospline  and  quadrative 
formula,"  in  Theory  and  Application  of  Spline 
Functions , edited  bv  T.  N.  E.  Creville, 
AcademLc  Press,  1969. 

9.  Breydon,  C.  0.,  "A  class  of  methods  for 
solving  non-linear  simultaneous  equations," 
Math.  Comp.,  Vol.  19,  1965. 


5.  Conclusion 


An  approach  to  problems  of  non-linear 
estimation  implementation  using  quadratures 
which  are  derived  from  monosplines  with  optimal 
knots  is  given.  The  quality  of  the  approximation 
depends  on  the  degree  of  monospline,  the  number 
of  knots  and  the  truncation  factor.  The  approx- 
imation error  is  reduced  by  efficiently  repre- 
senting the  density  function  in  digital  form. 

The  parameters  in  the  optimal  quadrature 
formulas  are  computed  a priori,  off  line  using 
simplifications  of  non-linear  equations  which 
specify  them.  Specifically,  the  separation  of 
linear  and  non-linear  parameters  leads  to  a 
powerful  and  accurate  iteration  scheme  to 
obtain  the  monospline  with  optimal  knots. 
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